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THE PROBLEM. 

A major challenge to psychometricians is the assessment of 
problem solving or inquiry behaviors. Attempts have been made 
to (l) observe both lover animals and humans in problem situa- 
tions and to infer the mental processes used by the subjects to 
solve problems. (See, for example, Thorndike, 1898 ; Morgan, 189 b ; 
Kohler, 19^7; Tollman, 19b8; Duncker and Krechevsky, 1939; Piaget, 
1928). In addition, (2) human subjects have asked to verbalize 
their thoughts in problem situations in an attempt to observe pro- 
blem solving behaviors more adequately (for example, Duncker and 
Krechevsky, 1939; Bloom and Broder, 1950; Duncker, 191*3). Both 
of these methods are long and tiring for the subject and the in- 
vestigator. However to supplant these methods of evaluating 
human behavior with a valid written test has been a difficult 
step. 

Problem solving or inquiry may be defined as a reaction be- 
havior to a psychological situation. Tests which measure a 
subject's reactions in new situations are exemplified by the maze 
tests. One such test. The Porteus Maze Test consists of a series 
of printed line mazes, steeply graded in difficulty in which the 
child must draw the shortest line to the maze without crossing 
over the boundary. Another example of this type of problem sol- 
ving is the "Manikin Test" found in the Pintner Patterson Performance 
Scale. In this test the child is asked to assemble a crude 
wooden figure of a man from arms, legs, head and trunk. 

Problem solving or inquiry may also be defined as a type of 
reasoning behavior. Reasoning in Russell's (1956) terms, is very 
similar to problem solving. In reasoning, however, any activity 
is limited to the manipulation of images, symbols and symbolically 
formulated propositions, rather than the overt manipulation of 
objects. One test to design t! *s aspect of problem solving is 
the Davis-Eels Games. 

This test requires not reading. All instructions are 
given orally by the examiner. The content is entirely 
pictoral and consists of problems chosen from everyday 
life experiences of children in urban American culture. 

(Anastasl, 1961 , 267 ). 

The authors of this test recommend that the score be described, 
not as IQ, but as the Index to Problem Solving Ability (IPSA). 

Guilford's factor analytic research resulted in the develop- 
ment of two tests, one of which is designed to measure "diver- 
gent thinking" and the other to venture "convergent thinking". 
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The factors of fluency, flexibility, and originality are de- 
scribed as "divergent thinking', or as Guilford describes it, 
"the kind of thinking that goes off in different directions". 
(Guilford, 1959, 38l). In contrast "convergent thinking" 
leads to a single right answer determined by the given facts. 

The Primary Mental Abilities Test and the Differential Ap- 
pitude Test contain sections designed to measure verbal and 
abstract reasoning. In addition general achievement batteries 
such as the Sequential Test of Educational Progress and the 
Metropolitan Achievement Test contain sections which are used 
to measure problem-solving and reasoning. It is obvious, how- 
ever, from the reviews found in Buros (1959), that few available 
test scores can be Interpreted to indicate the steps that a 
student uses in inquirying into or solving a problem. In the 
past 



• • * test constructors have tried to construct items which 
were so structured that by analysing the students' answers 
one could infer the problem-solving process which the stu- 
dent used. ... By knowing the answer choice the student 
made we could then know the method he used to solve the 
problem. Verbal problem-solving in general has shown 
that the types of items and variety of subject matter in 
which this technique can be used are few. Although it 
may appear that the process can be inferred, studies usu- 
ally show students can come up with ways and answers often 
correct that no teacher seemed to have anticipated. When 
accurate knowledge of the process is required, actual re- 
cording of students' problem solving processes can be con- 
sidered generally preferable in the majority of cases to 
inferences from the product. (Bloom, 1956, p.12?). 

Beaded then, is an instrument which would sample student behaviors 

as he solves a problem or inquires. 



RELATED RESEARCH 

Several attempts have been made to examine and evaluate the 
Individual inquiry processes of behavior of students. One example 
is the Questeat developed by Suchman (1962). In this test spe- 
cial films are used to present problem episodes to individual 
elementary school students. The students are then asked ques- 
tions which the examiner answers only with a "Yes" or "No" res- 
ponse. The entire session is tape recorded and subsequently 
analysed. Following this question asking session the student 
is given a paper-and-pencil test designed to measure (1) what 
principles he has discovered through inquiry session; (2) which 
of the necessary conditions he can identify and how accurately 
he can identify them; and (3) how many objects, conditions, and 
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events of the episode he has positively identified and correctly 
assumed. In th*s manner, inquiry or problem solving behaviors 
are evaluated by noting how much information, and how many rela- 
tionships and principles are induced from the gathered information. 

This is the "end-product" approach which is founded on the 
assumption that if all factors are equal, the child who is 
a better inquirer will obtain more data and will learn more 
from the data he obtains. (Suchman, 1962, p. 65 ). 

The processes used by the children, on the other hand, are analys- 
ed by Suchman in terms of the structure and function of the ques- 
tions asked, the fluency of the questioning, the relative fre- 
quency of the various question types, the over-all plan or strate- 
gy used in the grouping or sequency of the questions. 

Another example of the measurement of problem solving behaviors 
is Read's (19^9) Picture Test. This instrument is described as 
measuring the ability to use the scientific method. According 
to Read, 



... a test of the ability to think in the scientific 
method pattern should require the testee to go through 
the steps of a scientific method in order to arrive at 
the correct solution of the problem of the test. 

(Read, 19^9, p. 361). 

Accordingly "failure to apply these steps should result in 
a low score on the test". 

Riaoldi (1955) described an attempt to analyze the processes 
of thinking and problem situations rather than its end-product as 
Indicated by a certain answer. Additional studies by Rimoldi 
(1955) and Eccles (1959) represent attempts to analyze students' 
behaviors in science problem situations by using a series of cards 
on which scientific information was found. Analysis of the se- 
quence of card choice was taken as an indication of the steps used 
by the subjects in problem solving or inquiry. 

Glaser, Damrin and Gardiner (1952) were among the first to 
propose the use of a tab-item test to measure problem solving 
behaviors. As described by Glaser: 

A Tab-Item presents an examinee with the following: a 
description of the problem situation; a series of dia- 
gnostic procedures which if employed might yield in- 
formation relevant to the solving of the problem; and 
a list of specific solutions one of which is correct » 

In taking the test the examinee selects any number of 
procedures presented which he thinks will provide him 
with the information necessary to solve the problem. 












The resulting information from whatever procedures the 
examinee chooses are given him at the time he selects 
them. This is accomplished by giving the results or 
consequences of a procedure in the form of written or 
diagrammatic information which is covered by a tab 
fastened to the page. When the examinee selects a 
procedure he rips off the tab and obtained the results 
of the procedure he has "performed”. In a like manner 
an examinee is informed of the correctness or incor- 
rectness of his choice of a solution. An examinee 
works on an item until he has the correct solution de- 
noted by the word "yes” under the corresponding tab. 

(As quoted by Bloom, 1956, p. 127-;28). 

Thus, in the tab format, the sequence or tabs pulled gives an in- 
dication of the problem solving or inquiry behaviors of the 
subject. 

Cross and Gaier (1955) also used the Tab Format when they de- 
veloped the Balanc ed Problem Test (BPT). The development of the 
BPT was an attempt to measure the extent to which an individual 
selects and makes effective use of principles in contrast to us- 
ing factual information in problem solving. The tab format allow- 
ed the examinee to remove irreplaceable tabs from the test. Under 
these tabs was specific data that could be used in the solution 
of the problem. 

An instrument developed by Butts (1965), based on the tab 
format was used to study patterns of problem solving of college 
students. This instrument presented the student with (l) a spe- 
cific problem; and (2) a series of questions pertaining to the 
problem. Answers to these questions were covered by numbered 
tabs. Patterns of problem-solving behaviors were inferred from 
the order of tabs pulled by the subjects. Jones (1966) modi- 
fied this test to measure an instrument to inquiry skills of 
sixth-grade students. As redesigned, the instrument consisted 
of four sections: (l) in a written response the student predicted 
what would have happened in a described situation; (3) the stu- 
dent gathered data concerning the problem by pulling numbered 
answer tabs from questions he choses to ask. Each of these 
questions were structured so that the answer is a ”yes" or 'W' 
response. In part (k) the student applied his gathered knowledge 
from section (3) to explain why the situation happened as it did! 
Each numbered tab in section (3) was placed on an attached card 
when it was removed from the test by the student. These tabs 
formed a sequential record of the data selected by the student 
in the solution of the problem* Analysis of written responses 
in section (2) and (k) gave an indication of the problem-solving 
or inquiry behavior employed to solve the problem. 
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In terms of the analysis of problem solving behavior it is 
noted that in the literature there is a lack of agreement con- 
cerning whether or not there is a pattern that can be employed 
to solve all problems by students. Tests designed to measure 
problem solving or inquiry behaviors have given little or no 
indication of how these behaviors are used by children to ar- 
rive at answers. 

OBJECTIVES 

There were three objectives in the development of an in- 
ventory of science methods using the TAB Format: 

a. The development of the TAB Science Test . 

b. The development of a manual for administering the 
TAB Science Test . 

c. The establishment of norms of the TAB Science Test 
Including reliability and validity data. 



METHOD 



THE DEVELOPMENT 07 THE TAB SCIENCE TEST. 

If inquiry is a learned behavior some students may be ex- 
pected to be more proficient inquirers than others. However, the 
evidence of measurable differences in inquiry among students re- 
requires a clear definition or description of these behaviors. 

As noted previously, there is a notable absence of an unam- 
bigious description of specific student behaviors involved in in- 
quiry. Suchman' 8 inquiry studies represent one attempt to identify 

and describe specific inquiry behaviors of students. He proposed 
that, given a science problem to investigate the student should 
be led to comprehend that there are some more productive ways of 
inquiry that might help them explore the problem. Suchman (19 62) 
analyzed how inquiry was conducted by the elementary school student. 
He has described a student* s action in inquiring into a problem 
situation as (1) searching, (2) processing data, (3) discovering, 
and (b) verifying. However, 

while none of these actions is unique to inquiry they 
are all essential to it, and in combination form a 
cycle of operation that characterizes the inquiry 
process. (Suchman, 1962, p. 5). 
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also has been hypothesized thet shat ^>s {found through inquiry 
* child often leads to the expansion of his conceptual systems 
through what Piaget (1950) calls assimilation and accommodation • 

These five activities (searching, processing data, discover- 
ies* verifying, assimllating-accommod&ting) were the specifics for 
a model to clearly identify and define inquiry behaviors. In this 
model the actions of inquiry are not separate and discrete entities. 
Each activity is dependent on others that have preceded or will pre- 
cede it. A representation of the model of inquiry behaviors is 
illustrated in Figure I. 

A student who finds himself in a problem situation may 
search and process data. However, his searching and data pro- 
cessing operations are dependent on his past searching, data pro- 
cessing, verifying, discovering, assimilating and accommodating 
behaviors are also dependent upon his searching and data processing 
behaviors. 

Inquiry thus is represented as a cyclic operation. The end- 
products of inquiry are the expansion of conceptual systems and 
the abilities to use these expanded systems to produce inquiry 
into other situations. 

In a common essay or short answer test inquiry is measured 
by assuming that if a student knows the answer to the proposed 
problem he is a proficient searcher, data processor, discoverer, 
verifier, assimilator and accommodater. In the essay or short - 
answer test, no indication is given of the behaviors that the 
student employs while inquiring into the problem situation. 

With the TAB Science Test the measurement of the behaviors 
presented in the inquiry model are inferred from the student's per- 
formance. That is, the inquiry behaviors of a student are evaluat- 
ed by analyzing what he does when (1) searching, (2) processing data, 
(3) discovering, and (U) verifying. In addition, the student is 
allowed to apply conceptual understandings to new situations; an 
illustration of his assimilation and accommodation of concepts. 

t 

The TAB Science Test , using the Tab-Item Format, samples 
the behaviors of inquiry as identified in the inquiry model. For ' . 
each of the two parallel forma of the TAB Science Test . There are 
four sections: 

8ection 1: 

The student is presented with a science problem in the form 
of a physics problem-focus film. He is then asked to select from 
a set of explanations the one that he thinks to be the most correct. 
These explanations were selected from oral explanations given by 
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elementary school students in classroom situations. In this first 
section the student either selects the correct answer or the in- 
correct answer. Knowledge of his selection gives an indication 
of his behavior as a verification or discovery type. If the stu- 
dent hypothesized the correct solution of the problem before gather- 
ing clue data, he is verifying a solution. If the student does 
not know the correct solution to the problem before gathering clue 
data, his solution is a discovery. 

Section II. 

In the second section the student is presented with several 
(10 to 16 ) clue questions which he may use to help him solve the 
problem. The answer to each question is covered by a laminated 
tab attached to the test with double edged masking tape. If the 
student wishes to ask a question he is free to remove the corres- 
ponding tab to find the answer. However, before he is allowed 
to remove any tabs the student is instructed to read all of the 
clue questions. This precaution is taken to discourage the stu- 
dent from taking the "cafeteria" sequence; that is taking tab A, 

B, C . . . 



Each question in Section II was selected from groups of 
questions asked by students in similar problem situations. Pre- 
vious to the draft of the test, 30 one-half hour to one hour 
Inquiry sessions with bth-5th-and 6th-grade students were held. 
These sessions were based on the format developed by Suchman (1962). 
In the inquiry sessions students were shown the identical film 
found in the TAB Science Test . They were asked to solve the 
problems after gathering clues by asking questions of the in- 
vestigators. In answering the questions one basic restriction 
was imposed: the question had to be structured so as to be an- 

swerable by a "yes" or a "Ho" response. This restriction elimina- 
ted open-end questions and forced the students to focus and struc- 
ture their queries. As Suchman (1962) indicated: 

For example the child may not ask "How did the heating 
affect the metal?" but he may ask "Did the heating change 
the metal into a liquid?" In the first instance the child 
does not state specifically what information he wants. He 
is asking the teacher to conceptualize relationships for 
him - that is to teach him something - this is the very 
anthesis of what inquiry is designed to do. (Suchman, 1962, 
p. 30). 

For this reason the questions in Section 2 of the TAB Science Test 
are answered by "Yes" or "No" responses. 

Questions most frequently asked by students during the inquiry 
session were identified. These questions were analyzed by a panel 
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of seven judges who tested each clue question for scientific ac- 
curacy, question value, (is the question relevant, additional, 
or irrelevant to the solution of the problem?) and question type 
(what kind of information is included in the question*) Inter- 
class correlation coefficients were calculated and are presented 
in Trble I. Complete categorization of the TAB Science Test 
questions are found in Appendix C. — — 



TABLE I 

Judgmental Reliability Coefficients of TAB 
Science Test Questions* 

la* Question value. 

Test Form and Part Intraclass Correlation 

A - 1 0.713 

A - 2 0*715 

B - 1 0*796 

B - 2 0*816 



lb* Question Type 

Test Form and Part 
A — 1 
A - 2 
B - 3 
B - 2 



Intraclass Correlation 
0*668 
0*79k 
0*812 
0*806 



Analysis of the students performance in Section II gives an 
Indication of his searching and data processing behaviors* A stu- 
dent proficient in searching should not choose clues which are ir- 
relevant to the problem* A student proficient at data processing 
should organize data into logical and nonredundant sequences of 
clue questions* 

Section III 

In Section III the student is presented with the same series of 
explanations as found in Section 1* However, to the right of each 
of the explanations is a numbered TAB* When the student is ready 
to select one of the explanations, he is free to pull the TAB and 
see if he is correct* A correct answer has a "Yes" response under 
the numbered TAB* 
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In Section III knowledge is obtained of the success or lack 
of success of the student's verification or discovery behaviors* 

If the student hypothesises the correct solution in Section I and 
then (immediately after gathering clues in Section II) selects the 
correct solution again in Section III he is a more successful veri- 
fier than the student who selects the incorrect solution in Section 
III before deciding on the correct solution* This same trend holds 
for successful and nonsuccessful discoverers* 

Section IV 

At the end of each test two multiple choice questions are 
asked of the student* These questions cure used to evaluate the 
student's ability to transfer discovered or verified concepts* 

Thus, the section gives a measure of assimilation and accommodation 
behaviors* 



Administering the TAB Science Test 

A separate answer sheet is used to record questions asked 
by the student on the TAB Science Test * Each TAB covering the 
answer on Section II is lettered to correspond with the lettered 
question* For example, a "G" is printed on the tab covering the 
answer to question "G". Also each TAB covering the answer in Sec- 
tion III is numbered to correspond to tho numbered explanation • 
After removing the TAB from the test the student places the TAB 
on the answer sheet in the space provided* Since each TAB is 
identified by a letter or a numeral the TABS on the sheet form 
a sequential record of the information and explanations selected 
by the student* This procedure supplies the number, type and 
sequence of questions asked by a student in solving a problem* 

Thus it indicates not only the student's problem solution but 
also his inquiry behaviors* 

To facilitate the use of the test the student copies the 
letters and the numerals of the TABS on his answer sheet* Then 
he replaces the TABS on the instrument in correct alphabetic or 
numeric order* Using this procedure the tests are ready for 
immediate re-use while a complete sequential record of TABS 
pulled by the student is available on the answer sheet* In the 
case of Parts A-2 and B-2 where Section IV is included, adequate 
space is provided for an answer sheet for the student to answer 
the two concept-transfer questions* 

An example of the use of the answer sheet is found in Figure 
2* Copies of the TAB Science Test * Forms A and B are found in 
Appendix A* 
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FIGURE 2. TAB SCIENCE TEST 
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QUESTION #1 

a. b* Student ans- 
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SCORIHG THE TAB SCIENCE TEST. 



A crucial aspect in the development of the TAB Science Test 
vas the identification of a scoring technique that reveals sped- 
fie Inquiry behaviors. Suggestions for seorisg similiar instruments 
have included: 

(1) Compare the order of tab pull of students with 
those who are proficient in inquiry against 
"optimal sequence" of tab pull. 

(2) Use the sum of "utility scores" of tabs (Rimoldi, 

1955) which are defined as ratios between the 
number of times that individual clue items are 
selected in the total number of subjects in the 
test sample. 

(3 Use the number of TAB questions chosen by the 

student before selecting the final correct answer 
or use an average or minimum number of tabs as a 
criterion. 

(b) Use a weighted-error count where the clue tabs are 
weighted in reverse relation to their relevance in 
isolating the answer to the problem. 

In this study the weighted-error count that was proposed by 
Glaser, Damrln and Gardner (1952) was selected as a major basis 
behind scoring of the TAB Science Test . In this method the stu- 
dent is penalised in choslng Irrelevant and additional information 
clues more so than he is in choosing relevant clues. 

Another important aspect considered in the scoring procedure 
of the TAB Science Test is the order of TAB pull. While it is 
recognized that not all problems maybe solved in a similar manner 
it is important that logic guide the inquiry behaviors of students 
regardless of what method is used to solve a specific problem. For 
example, a student inquiring into Part A-l of the TAB Science Test 
finds the following question in Section II. 

Question B. Was the water in the bottle with the 
yellow balloon before the bottle was 
put on the firet YES 

I. Did the water with the yellow balloon 

contain something besides air? YES 

It is understandable that if a student ask question "X" 
a logical choice to follow would be question "B". However, if 
he ask question "B" then question "I" would add nothing to his 
storehouse of knowledge. It would be an illogical question. 
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A computerised scoring system was developed to score the TAB 
8clence Test* This scoring system takes into consideration number, 
type a nd value of clues obtained by the student • Also taken into 
consideration is the order of tab pull* Flow sheets such as that 
in Figure 3 (and in Appendix D) were developed for each test problem. 
On these sheets letters indicated the clue questions and numerals 
indicate the problem solution. Arrows indicate possible connec- 
tions between clues and problem solutions, and between clue questions 
anfl other clu© questions • Arrows which ere blocked ( ■■ 1®- 

dicate an illogical clue gathering sequence. Double pointed arrows 
( f — a > ) indicate redundancies. 

Low numerical values are assigned to relevant clue questions, 
to logical and non-redundant sequences and to plausible problem 
solutions, f Subtraction of the sum of all tab and sequence scores 

counted against a student from the constant gives the final score* 

The constant is the maximum number of points that could be counted 
against any scoring sequence. 

Table 2 reveals the scoring system used by the TAB S c iep^eJ Pest,. 

For each student a page of data is available in the format 
exemplified by Figure U. 



The student * s name and the identification number for his class , 
sex, and TAB Science Test Form are found at the top of Figure 4. Be- 
low this identification fire two graphs. The graph at the top of the 
figure represents the firr i problem of the TAB Sc ience Test Form B 
(The Air Sled). Bordering the graph as the abs7;issa are numerals 1 
throu gh Ik bordering the graph as the ordinate are numerals- 1 through 
k and letters A through J • 

An asterisk (*) on the graph indicates the specific clue TAB 
that was selected by the student. For example in Figure 4, it can 
be noted that the first clue TAB selected by this student was TAB E. 
After TAB E was selected, the other TABS selected were TAB J, A, C, 

0, D, H and B. After pulling these TABs the student pulled TAB 2 
from the answer page. Under TAB 2 was a "Yes” response so the 
student knew he had found the solution to the problem. 

The same format as described above is followed in interpreting 
the graph found in the lower half of Figure k. This lower graph de- 
scribes the student’s behavior on TAB Science Test Form B Part 2 
(The Bi-Metallic Strip). At the lower left of the figure are six 
numbers 27* » 68 (10,0), 95, 266. 

The 27 represents the number of points counted against the 
student by invoking the test scoring system as represented in the 
upper graph. This number is the sum scores assigned to each tab 
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